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Using the band structure calculation and mean-field analysis of the derived three-chain Hubbard 
model with phonon degrees of freedom, we discuss the origin of the orthorhombic-to-monoclinic 
phase transition of the layered chalcogenide Ta2NiSe5. We show that the Bose-Einstein conden- 
sation of excitonic electron-hole pairs cooperatively induces the instabihty of the phonon mode at 
momentum q — )■ in the quasi-one-dimensional Ta-NiSe-Ta chain, resulting in the structural phase 
transition of the system. The calculated single-particle spectra reproduce the deformation of the 
band structure observed in the angle-resolved photoemission spectroscopy experiment. 

PACS numbers: 71.10.Fd, 71.30.-|-h, 71.35.-y, 71.20.-b 



The electron-hole pair condensation in thermal equi- 
librium into the excitonic insulator (EI) state has at- 
tracted renewed interest in recent years because of the 
discoveries of a number of new materials. The idea of 
EI was proposed about half a century ago where 
the EI state was predicted to be realized either in a 
semiconductor with a small band gap or in a semimetal 
with a small band overlap. The formation of excitons is 
driven by poorly screened Coulomb interaction between 
conduction-band electrons and valence-band holes under 
condition of a low carrier concentration. If the bind- 
ing energy of excitons is larger than the band gap, they 
may spontaneously condense at low temperatures and 
drive the system into a new ground state with exotic 
properties. This new state, which is a condensed state 
of a macroscopic number of excitons acquiring quantum 
phase coherence, is called EI 0, It has been pointed 
out that the semimetal-EI transition may be described in 
analogy with the BCS theory of superconductivity and 
the semiconductor-EI transition is discussed in terms of a 
Bose-Einstein condensation (EEC) of preformed excitons 

An example of materials for possible realization of EI 
is Tm(Se,Te), where it has been claimed that a transition 
into EI occurs by applying pressure U 12 1 and that the 
superfluidity of condensed excitons is responsible for the 
observed anomalous properties [isj . Another promising 
candidate for EI is CaBg 1J|, where the observed weak 



ferromagnetism with an unexpectedly high Curie tem- 
perature was interpreted in terms of a doped EI [ll[ll]. 
Also known as a candidate for EI is TiSe2 , where the ob- 
served charge-density- wave state was interpreted to be of 
an excitonic type [17H19| . The spin-density- wave state of 
the iron-pnictide superconductors has also been argued 
to be of the excitonic type i^-lS]- Semiconductor bi- 



layer systems have attracted attention as well in relation 
to the BEC of excitons 



23|. 



rial has a layered structure stacked loosely by a weak 
van der Waals interaction, and in each layer, Ni single 
chains and Ta double chains are running along the a- 
axis of the lattice to form a quasi-one-dimensional (ID) 
chain structure |26| . The observed resistivity shows a 
semiconducting behavior over a wide temperature range 
with a quasi-lD anisotropic electron conduction at high 
temperatures f27|. Then, an anomaly in the resistiv- 
ity appears at 328K, which is associated with a second- 
order-like structural phase transition from orthorhom- 
bic to monoclinic phase [l^]. The magnetic susceptibil- 
ity exhibits diamagnetism in a wide temperature range 
(4.2 — 900 K) and shows a sudden drop (being more neg- 
ative) below the structural transition temperature (328 
K) [27|. The system was thus suggested to be a small 
band-gap semiconductor with oxidation states of Ni'^+ 
(Bd^") and Ta^"*" (5d°), rather than a magnetic or Mott 
insulator [23,[3]. However, a recent X-ray photoemission 
spectroscopy (XPS) experiment, together with a cluster- 
model calculation, showed that Ni ions have a 'idPL char- 
acter {L is a Se 4n hole) and consequently Ta ions have 
a bd} character [24|. Moreover, the angle- resolved pho- 
toemission spectroscopy (ARPES) experiment 24, [jj! ] 
showed that the spectra are strongly temperature depen- 
dent, i.e., at 40 K the flatness of the top of the valence 
band is extremely enhanced and the size of the band 
gap becomes wider. It was thereby suggested that the 
EI state is realized as the ground state of this material, 
where the spin-singlet excitons between the Ni 3d-Se 4p 
holes and Ta 5c? electrons are presumed 24 1. 



Recently, a transition-metal chalcogenide Ta2NiSe5 
has been studied in this respect 2J, |25j. This mate- 



In this paper, motivated by such developments in the 
field, we make a theory to elucidate the origin of the 
structural phase transition and associated anomalous 
electronic properties of Ta2NiSe5. We first carry out the 
density-functional-theory (DFT) based electronic struc- 
ture calculations for the orthorhombic phase of Ta2NiSe5 
and find that the system is a direct-gap semiconductor 
with the gap minimum at the F-point of the Brillouin 
zone and has a simple band structure near the Fermi 
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level. No hybridization occurs between the top of the 
valence band and bottom of the conduction band. Based 
on the results, we construct an effective three-chain Hub- 
bard model to reproduce the three bands near the Fermi 
level. We then introduce the phonon degrees of free- 
dom into the model and analyze it by the mean-field ap- 
proximation. We calculate the ground-state and finite- 
temperature phase diagrams of the model to clarify the 
origin of the structural phase transition. The single- 
particle excitation spectra are also calculated. 

We thus show that the BEC of excitonic electron-hole 
pairs cooperatively induces the instability of the phonon 
mode at momentum g — >■ in the quasi-lD Ta-NiSe- 
Ta chain, resulting in the structural phase transition of 
the system. The spontaneous hybridization between the 
conduction and valence bands well explains the valence 
states of Ni and Ta ions observed in the XPS experiment 
[i^ l and also the calculated single-particle spectra well 
reproduce the deformation in the band structure near the 



Fermi level observed in the ARPES experiment |24l . 
Our results thus demonstrate a possible realization of 
the EI state in the simplest quasi-lD electronic system 
of the recently corroborated material Ta2NiSe5 and will 
encourage further experimental studies of this intriguing 
material. 
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FIG. 1: (Color online) Calculated band dispersions and PDOS 
of the orthorhombic phase of Ta2NiSe5. In (a), the width of 
the curves is in proportion to the weight of the Ta 5dxy orbital, 
in (b), the contribution from the Ta 5d t2g orbitals is shown, in 
(c), the the width of the curves is in proportion to the weight 
of the Ni 'idxz+yz orbital, and in (d), the contribution from 
the Ni 2)d t2 orbitals is shown. The Fermi level is indicated 
by a horizontal line. The local coordinate system defined in 
Ref. [H is used. 



We make the band structure calculations employing 
the code WIEN2k ^ based on the full-potential lin- 
earized augmented-plane-wave method, where we use the 
generalized gradient approximation for electron correla- 



tions with the exchange-correlation potential of Ref. |30|. 
Because the crystal structure of the high-temperature or- 
thorhombic phase of Ta2NiSe5 is not known, we make the 
structural optimization, keeping the orthorhombic struc- 
ture (space group Cmcm) and lattice constants [26|, and 
obtain the optimized internal coordinates of all the ions 
3l|. The calculated results for the band structure, how- 
ever, predict a metallic state with a small band overlap 
and are not consistent with experiment. This may be 
due to a well-known problem of DFT-based band calcu- 
lations, where the band gap in semiconductors is under- 
estimated. To amend this, we shift the conduction (va- 
lence) bands upward (downwards) by adding (subtract- 
ing) orbital-dependent potentials into the Hamiltonian as 
a standard procedure [sl, Is^l and reproduce the experi- 
mental band gap [31 1. 

The results for the partial densities of states (PDOS) 
and band dispersions thus obtained are shown in Fig. [T] 
We find that the system is a direct-gap semiconductor 
with the gap minimum at the F-point of the Brillouin 
zone in agreement with experiment 2J, |27| . The band 
structure near the Fermi level is rather simple; the con- 
duction band has a cosine-like quasi-lD band dispersion 
coming from the Sd^j/ orbitals of Ta ions arranged along 
the chain, whereas the top of the valence band has a 
quasi-lD dispersion coming from the Ni Zdxz+yz and 
Se 'ipx+y orbitals arranged along the chain, and no hy- 
bridization occurs between the top of the valence band 
and bottom of the conduction band. 
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FIG. 2: (Color online) (a) Noninteracting band dispersion of 
our model Eq. ([T}. The conduction band is doubly degener- 
ate, (b) Schematic representations of the three-chain Hub- 
bard model for the ID structural unit consisting of the two 
chains of the Ta bd^y orbitals yielding the c-bands and one 
chain of the Ni Sd^z+yz and Se '^Px+y orbitals of Ta2NiSe5 
yielding the /-band. The lattice distortion of the chain corre- 
sponding to the orthorhombic-to-monoclinic phase transition 
is schematically illustrated. 



Based on the results, we make the effective three-chain 
model containing the valence /-band coming from the hy- 
bridized Ni 'idxz+yz and Se ^Px+y orbitals and the doubly 
degenerate conduction c-bands coming from the Ta ^dxy 
orbitals, to which the Hubbard-type onsite {Uc and Uf) 
and interchain {V) repulsive interactions are added (see 
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Fig. [2]). We also introduce the electron-phonon interac- 
tion with strength g and the phonon term with phonon 
frequency uj^ assuming a uniform shear distortion of the 
chain (see Fig. [5]) corresponding to the structural transi 
tion from the orthorhombic to monoclinic phase [si 
The Hamiltonian reads 



(1) 



where c|, ^ ^ and fl ^ are the Fourier transforms of c| g. ^ 
that creates an electron with spin a {—t, i) at site i on 
the c-orbital of the chain a {— 1,2) and //^ that cre- 
ates an electron at site i of the /-orbital, respectively, 
n^g. ^ and n{ ^ are the electron number operators on the 
c- and /-orbitals, respectively. The noninteracting band 
dispersions are given as ec{k) = 2tc{cos k — 1) + D/2 — 
and ef{k) = 2i/(cosfc — 1) — D/2 — jj, with the hopping 
parameters tc and t/ and the band gap D. We use the 
values tc — —0.8, i/ = 0.4, and D = 0.2 in units of eV 
obtained from the fitting to the calculated band disper- 
sion (see Fig.[T]). is the chemical potential. We assume 
Uc = Uf (= U) for simplicity and choose V = U/A. The 
bosonic operator 6j creates a phonon with momentum q 
in the chain a. L is the number of the unit cell, where the 
unit cell contains an /- and two c-orbitals. We restrict 
ourselves to the filling of two electrons per unit cell. 

We apply the mean-field approximation n^.^rii,^ — 
{ni,-^)ni^l + n-f{ni^^) for the onsite terms of both c- and 
/-orbitals and nl^^^nl^ {nla,a)nl„ + ^...^('^j,^) - 

(/j,^Ci,^,a)c|_^_„/j,<x - flaCi.aA4,a,aA<y) ^r the inter- 
chain term. We define the order parameter for the spin- 
singlet excitons as A„ = |A|e*^° = jiT.k,A4,c,JkM) ^ 
excluding possibility of the formation of any density 
waves because the top of the valence band and bot- 
tom of the conduction band are both at the F-point 
of the Brillouin zone jj- Accordingly, the order pa- 
rameter for the uniform lattice distortion is defined as 
5a = 2g{hq=o^a) / ^fL with {hq^a) 7^ only at g = 0, 
whereby the shear distortion of the chain correspond- 
ing to the structural transition from the orthorhombic to 
monoclinic phase can be described by \5\ with 5i = \5\ 

the 



and §2 — —\5\- We use a parameter A = g /oJc 
following discussions. We define rt to be rt = {^1 ^ and 
which is a measure of the spontaneous 



procedure of the mean-field theory 31|, we derive the 
mean-field Hamiltonian and diagonalize it by the Bogoli- 
ubov transformation. The self-consistent (or gap) equa- 
tions are derived by the minimization of the free energy, 
which are solved numerically to obtain the temperature 
dependence of n, \5\, and |A|. 
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c-/ hybridization at T = K. Following the standard 



FIG. 3: (Color online) Ground-state phase diagram with the 
order parameters (a) |A|, (b) \5\, and (c) n, in the parameter 
space (V^, A), (d) Finite-temperature phase diagram with the 
order parameter |A| as a function of V at A = 0.04 eV. Also 
shown are (e) the V dependence of |A| and (f) A dependence 
of at T = K with Ac = 0.125 eV and 14 = 0.6 eV. Ab- 
breviations are BI (band insulator), EI (excitonic insulator), 
O (orthorhombic), and M (monoclinic). 



The calculated results for the ground-state and finite- 
temperature phase diagrams are shown in Fig. |31 As for 
the ground state, we clearly see in Figs. [3] (a)-(c) that 
when V and A are small the system is the band insulator 
(BI) with |A| = \5\ = but when V and A are large the 
EI state |A| > with the shear distortion of the chain 
\5\ > appears in the ground state. The EI state occurs 
simultaneously and cooperatively with the lattice distor- 
tion except at the lines A = and V = 0. We emphasize 
here that even if A is small the structural phase transi- 
tion occurs with help of the exciton condensation: i.e., 
the interaction V drives the El-state formation A > 0, 
which leads to the spontaneous c-f hybridization, and as 
a consequence, the structural distortion S > occurs even 
if A is small. The spontaneous c-f hybridization stabi- 
lizes the lattice distortion, leading to the orthorhombic- 
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to-monoclinic phase transition. This is consistent with 
the situation in the real material Ta2NiSe5, where the 
monoclinic distortion of the angle 0.5° — 1° (or the atomic 



displacement 0.02-0.04 A) is very small |26l . |27[ ; a rough 
estimation may be \S\ ~ 0.02 — 0.04 eV, which corre- 
spons to A ^ 0.02 — 0.05 eV [31]. The oxidation states of 
Ni^"*" and Ta^+ observed in the XPS experiment [231 are 
also consistent with the nonzero value of n induced by 
the spontaneous c-f hybridization in the EI phase (see 
Fig. He)). 

The temperature dependence of the EI phase is given 
in Fig. [Sjd), where we find that by lowering tempera- 
ture the BI state with the undistorted (orthorhombic) 
structure changes into the EI state with the distorted 
(monoclinic) structure and the transition is of the sec- 
ond order. Thus, the experimental situations are cor- 
rectly reproduced. We also point out that the observed 
sudden drop in the uniform magnetic susceptibility at 
the transition may be due to the formation of spin- 
singlet excitons that suppresses the paramagnetic part 
of the uniform spin susceptibility of thermally activated 
electrons. 
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The calculated temperature dependence of the single- 
particle spectra is shown in Fig.|4l where we find the large 
deformation of the top of the valence band caused by the 
spontaneous c-f hybridization in the EI state formation 
by lowering temperature: the flattening of the band dis- 
persion is evident and the shift of the top of the valence 
band away from the Fermi level is noticed, both of which 
are consistent with experimental ARPES results 24 , 2^1 ■ 
The hybridization can be seen in the c-orbital spectral 
weight below the Fermi level (see Figs.|4](d) and (e)) and 
/-orbital spectral weight above above the Fermi level (see 
Figs.|4](g) and (h)). Splitting of the c-bands into two is 
also noticed, where the lower "nonbonding" band remains 
unaffected in the presence of |A| and \6\. Note that the 
c-f hybridization is absent above the transition temper- 
ature (Tc) in our mean- field calculations (see Figs.|3](c), 
(f), and (i)). However, the characteristic temperature 
scale associated with the formation of preformed excitons 
should be present which we hope will be observed in 
any future experiment. 

In summary, we have discussed the origin of the 
orthorhombic-to-monoclinic phase transition of the lay- 
ered dichalcogenide Ta2NiSe5 using the band structure 
calculation and mean-field analysis of the derived three- 
chain Hubbard model. We have shown that the BEC of 
excitonic electron-hole pairs cooperatively induces the in- 
stability of the phonon mode at momentum g — ^ in the 
quasi-lD Ta-NiSe-Ta chain, resulting in the structural 
phase transition of the system. We have also shown that 
the spontaneous c-f hybridization explains the valence 
states of Ni and Ta ions observed in the XPS experiment 
and that the calculated single-particle spectra reproduce 
the flattening and shift of the band structure observed 
in the ARPES experiment. All of these results support 
the EI state formation due to the BEC mechanism of 
spin-singlet excitons for the intriguing phase transition 
observed in Ta2NiSe5. 
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FIG. 4: (Color online) Calculated temperature dependence of 
the single-particle spectra of the three-chain Hubbard model. 
(a)-(c): Total spectral weight, (d)-(f): spectral weight on the 
c-orbital, and (g)-(i): spectral weight on the /-orbital. We as- 
sume V = 0.55 eV and A — 0.04 eV. The calculated transition 
temperature is ksTc = 0.0783 eV. The Lorentzian broadening 
of the spectra of 0.01 eV is applied for comparison with the 
experimental ARPES spectra ^24^. i25| . The band dispersion 
without condensation |A| = \5\ = is given by the dashed 
curves. The Fermi level is indicated by a horizontal line. 
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